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Abstract 

We deal with the problem of streaming multiple video streams between pairs of nodes 
in a multi-hop wireless ad hoc network. The nodes are static, know their locations, and 
are synchronized (via GPS). We introduce a new interference model that uses variable 
interference radiuses. We present an algorithm for computing a frequency assignment and 
a schedule whose goal is to maximize throughput over all the video streams. In addition, 
we developed a localized flow-control mechanism to stabilize the queue lengths. 

We simulated traffic scheduled by the algorithm using OMNET-i-H-/MixiM (i.e., phys- 
ical SINR interference model with 802. llg) to test whether the computed throughput is 
achieved. The results of the simulation show that the computed solution is SiNR-feasible 
and achieves predictable stable throughputs. 



1 Introduction 

We address the problem of routing real-time video streams in static ad hoc wireless networks. 
Our goal is to develop and implement an efficient algorithm and test it in a realistic physical 
model. Many works have been published on the topic of multi-hop routing in wireless net- 
works including real-time video streaming (see [ SYZ+OSl rKPS+06[ [ShaOSi IvDSOSII ). In these 
works it is acknowledged that cross layer algorithms are required to utilize the capacity of the 
network. These papers evaluate specific algorithms and scenarios using approximate models 
for wireless network, and thus the question of developing integrated realistic solutions remains 
open. In particular, a solution must address a combination of specifications including: maxi- 
mize throughput, fairness, minimize delay, stability of throughput, stability of queue lengths in 
intermediate nodes, bounded number of lost packets, and predictability. 

One of the main issues in wireless networks is how to model interferences. In the commu- 
nication community, one uses the signal-to-interference-plus-noise ratio (SINR) to determine 
if a received signal is decoded without an error [jGal68J. On the other hand, the algorithms 
community has used the graph model (or protocol model) to model feasible communication 
pattems PPPQ05[ IABL05L For the graph model, multi-hop routing algorithms with a con- 



stant approximation ratio have been developed nKMPSOSl lABLOSi IBSTZ07[|mn09ll . In fact. 
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Wan [|Wan09ll even presents a (theoretical) PTAS for the problem. On the other hand, to date 
approximation algorithms for throughput maximization in the SINR model do not have a con- 
stant approximation ratio. For example, in [ CKM+OSl . the approximation ratio is logarithmic 
in the ratio between the longest link and the shortest link (for uniform transmission powers), 
and in HEMMll H the approximation ratio is logarithmic in the number of nodes (for the linear 
power model). 

The study of wireless algorithms in the SINR model has been motivated by its realistic 
appeal. In fact, it has been argued that the performance of graph based algorithms is inferior to 
algorithms in the SINR model [,GQW07J . In [MWW()6l rMWZ06H a logarithmic ratio between 
the throughput in the SINR model and the throughput in the graph model is presented. A 
closer look at studies that compare the interference models and algorithms for these models 
shows only a constant gap if the ratios of the max-to-min power and max-to-min distance are 
constant. In [GKOOH the same asymptotic throughput is obtained in both models with respect to 
random instances. In [IMWW061I . the example only gives a constant ratio if the the power ratio 
and the distance ratio are constant. In [|CKM+081. an example with a constant gap is presented 
for constant uniform power. In [BR03|, the theorems do not utilize the ability to increase the 
interference radius or to apply collision avoidance methods used in the 802.1 1 MAC. 

The questions we study in this paper are as follows. 

(i) How much of the traffic computed by a graph model based routing algorithm can be 
routed in realistic scenarios with constant max-to-min powers and constant max-to-min 
distances? Namely, does the approximate nature of the graph model lead to useful solu- 
tions? 

(ii) How to integrate a graph-model based routing-algorithm in a system that supports real- 
time video streaming? Such a system must combine goals such as: fairness, predictable 
throughput, few lost packets, bounded intermediate queues, reasonable and steady end- 
to-end delay. 



Previous Work. The necessity of cross layer designs has been recognized for satisfying the 
special characteristics of real-time video streaming over wireless networks flShaOSl ISYZ+05 , 
lKPS"'"06l . We continue this line of work. 

The multi-hop routing problem for ad hoc networks was investigated thoroughly. One of 
the commonly used heuristics for routing is based on finding paths with maximum bottlenecks, 
namely, paths for which the edge with the lowest capacity is maximum [IDPZ04II . We used this 
algorithm in our benchmarks (we call it S hortP). A different approach for the routing problem 
is based on solving a linear program. In [iKMPS05[ |JPPQ05[ lABLOSll . routing algorithms in 
the graph model are designed, analyzed, and simulated. One drawback in [|KMPS05„ , JPPQ05 



lABLOSll is that the simulations were run also in the graph model and not in the physical model. 
Wan ||Wan09ll pointed out various errors in previous algorithms and presented a new linear 
program that corrects the problem. He proved that: (i) there is a 23-approximation algorithm 
based on the linear program, and (ii) there is a polynomial time scheme (PTAS) for the problem. 
However, this PTAS is not practical. Namely, the PTAS requires solving a linear program that 
might not be solved by LP- solvers even for moderate sized networks. 

Chafekar et al. HCKM+OSi |Cha09ll considered routing algorithms in the SINR model. The 
approximation ratio of their algorithm with uniform power assignments is logarithmic in the 
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ratio between the longest link and the shortest link. Their communication model does not 
include ACK packets. Hence, interference is caused only by the sender and not by the receiver. 
In [|Cha09ll . simulations are described in the physical model, but these simulations do not use 
the 802.11 MAC (i.e., no RTS, CTS, ACK packets are used). 

Three scenarios are simulated in [|Cha091 : random network, grid, and a realistic road-traffic 
network. The path loss exponent in the simulations is a = 6, which is considered rather 
high and fit for indoor environments (but not open air environments). In the grid scenario, the 
nodes are located 10 meters apart (both horizontally and vertically), and the communication 
range also equals 10 meters. Thus, communication is possible only between closest neighbors. 
Interference caused by a node that is located a diagonal away (i.e., 10a/2 meters away) is 8 
times smaller, and interference caused by a node 20 meters away is 64 times smaller. Thus, 
interferences in this setting fade very quickly, justifying a small gap between the SINR model 
and the graph based protocol model. Another aspect in the simulation of [|Cha09il is that routing 
is limited to single paths (i.e., no splitting). It is not clear if this is an implementation issue or 
a result of the simulated instances. 

Special Characteristics of Real-time Video Streaming. Streaming of real-time video in a 
multi-hop ad hoc network is a challenging task with unique characteristics. 

(1) End-to-end delay in streaming of real-time video should be as small as possible. We as- 
sume that a delay of 1-2 seconds is tolerable if the video has to travel across 10 hops. 
One implication of this constraint is that end-to-end acknowledgments and TCP are not an 
option. 

(2) Unless erasure codes are employed, loosing even a small fraction of the packets incurs an 
intolerable degradation in the video quality. We assume that video has acceptable quality 
if less that 0.5% of the packets are dropped. In wireless networks, each link can have a 
PER of l%-5%. Thus, after 10 hops, one is left with intolerable erasures. On the other 
hand, erasure codes incur an extra end-to-end delay since they need to accumulate data for 
a block before encoding can take place. This means that relying on WiFi acknowledgments 
and retransmit capabilities can be useful to avoid packet drops if the per is small. 

(3) A useful feature in video coding is the ability to adjust the compressed bit-rate. This 
means that the video encoder can be continuously controlled to generate a video stream 
of a requested bit rate. We rely on this feature in our flow control algorithm. This feature 
separates video streaming from other applications such as FTP. 

Our Contributions. 

1. We do not modify the 802. llg MAC. This approach has two advantages. First, we do 
not bypass the wireless NIC and its collision avoidance features. Hence, even if the 
algorithm suggests a schedule with interferences, these interferences are resolved by the 
MAC. Second, the network can support limited additional traffic that is not routed or 
scheduled by the algorithm (i.e. messages for controlling the network). We choose the 
802. llg because of its popularity in laptops and mobile devices. 
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2. Simulation in the physical model. The simulation is in a standard 802.1 Ig setting using 
OMNET++/MixiM (see Sec. 16.11) . In this setting, all WiFi frames are transmitted (i.e., 
RTS,CTS, packet, ACK), and interferences between frames are analyzed using the SINR- 
model, and taking into account the Modulation Coding Schemes (MCS). 

3. We introduce new interference constraints that constitute an intermediate model between 
the physical SiNR-model and the graph based protocol model (see Sec. 13.11 ). The inter- 
ference set of a link is a function of the signal-to-noise ratio of the link and the MCS 
of the link. As the signal-to-noise ratio (without interferences) of a link is closer to the 
SiNR-threshold, the interference set grows, so that SINR is not in the "waterfall" region 
of the PER function^ One advantage of this new interference model is that it is easy to 
formulate interference constraints in the linear program formulation (see Sec. |B]in the 
Appendix). 

4. We formulate the problem of minimizing end-to-end delay incurred by a schedule that 
supports a given multi-flow. We developed and implemented a scheduling algorithm 
that addresses this problem of reducing end-to-end delays while supporting a similar 
throughput (see Sec|43]). In [IKMPS05L lABLOSl IBSTZOTH the effect of the schedule on 
the delay is not mentioned. 

5. We developed and implemented a flow control algorithm that stabilizes the queue lengths 
and controls the data-rate along the links. This flow control algorithm is executed locally 
by the nodes. 

6. We evaluated the performance of the proposed algorithm with respect to video streaming. 
In particular, we measured the throughput, end-to-end delay, fraction of dropped packets, 
queue lengths, and the stability of these parameters. 

Techniques. Following [IKMPS05L IABL05L IBSTZ07L lCKM+08[ EMM 11 II , we formulate an 
LP, and apply greedy coloring to obtain a schedule. Interestingly, the greedy coloring incurs 
high end-to-end-delays, so we developed a path-peeling scheduler that trades delay for through- 
put. Stability is maintained by a flow control algorithm that monitors flow through incoming 
and outgoing links, and continuously balances the two. This method utilizes the ability of video 
encoders to adjust the compressed bit-rate. 

2 Problem Definition 

Setting. We consider a WiFi 802. 1 Ig static ad hoc network with 3 non-interfering radio chan- 
nels with the assumptions: (i) Single radio: each node has a single wireless network interface 
controller (WNIC). (ii) Each node is equipped with a GPS so that it knows its location and the 
nodes are synchronized, (iii) The WNICs support quick synchronized hops between frequency 
channels, (iv) Isotropic antennas, (v) We also assume that the nodes have already joined the 
network and that there is at least one node (i.e., center node) that holds full information about 

'The packet-eiTor-rate (PER) is a function of the SINR. This function increases very steeply in the neighbor- 
hood of the critical threshold f3. This phenomenon is referred to as the "waterfall" region of the per function. 
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the network (i.e., nodes and locations). Accumulating this information can be done in a dis- 
tributed low-bandwidth fashion after building a spanning tree [|Awe87ll . 

Problem Definition. The input to the algorithm consists of: 

1 . A set y of n nodes in the plane. A transceiver is located in each node. 

2. A set of k video stream requests {rj}^^^. Each stream request is a triple rj = (ai,bi,d*), 
where is the source (e.g., camera) of the stream, bi is the destination, and d* is the 
required data-rate. 

Ideally, we would like to satisfy all the requests, namely, for each video stream r,, route packets 
using multi-hops from aj to 6j. We assume that there is a path in the network between each 
source-destination pair (otherwise, the request is rejected). 

Let di denote the data-rate achieved for the ith stream. The service ratio pi of the ith 
demand is defined by pi = di/d*. Our goal is to maximize the minimum service ratio, namely, 
max minj pi . 

Additional performance measures are: (i) End-to-end delay - this is the time it takes a packet 
to reach its destination. We are interested in reducing the maximum delay (among the packets 
that are delivered) since the video is real-time. In addition, the maximum delay determines 
the size of the jitter buffer in the receiving side, (ii) Number of dropped packets. Queue 
management may drop packets. A dropped packet never reaches its destination, (iii) Queue 
lengths in intermediate nodes tell us how much memory should be allocated and also give an 
indication of the delay per hop. 



3 Preliminaries 
3.1 Interference Models 

Bidirectional interference. The delivery of a message in the WiFi MAC requires transmis- 
sion of frames by both sides (e.g., RTS and packet are transmitted by the sender, CTS and ACK 
are transmitted by the receiver). Hence, interferences can be caused also by frames transmitted 
by a the receiving side. 



The SINR model. The SINR model, also called the physical interference model, defines 
successful communication as follows. Let du^v denote the distance between nodes u and v. 
Suppose a subset St V of the nodes are transmitting simultaneously in the same frequency 
channel as u. The signal-to-interference-plus-noise ratio (SINR) for the reception by t> G V\St 
of the signal transmitted hy u E St in the presence of the transmitters St is defined by 

SlNRiu,V,St) ^ ^^"^"'^ 



Each transmitter can use one of several modulation coding schemes (MCS). The message trans- 
mitted by u in an MCS m is successfully received by v if SINR(m, v, St) > (3^, where (3^ is the 
minimum SINR-threshold for the MCS m. 
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Protocol model. The protocol model, also called the graph model, is specified by two radii: 

(i) A communication distance r. (ii) An interference distance R. The rule for successful com- 
munication between two nodes u and v is that v receives the message from u if du^v < r and 
every other node x that transmits at the same time satisfies dx,v > R- In this model, a commu- 
nication graph is defined over the nodes. Two nodes are linked by an edge if their distance is 
less than the communication distance r. 

Since the WiFi MAC requires transmission by both sides, an interference is defined between 
two links {u, v) and {u', v') if min{duy, duy, d^y, dv,v'} < R- We say that a subset L of links 
is non-interfering if no two links in L interfere. In the protocol model, a schedule is a sequence 
{Lj}j of subsets of non-interfering links. 

Our new model. The new model is an intermediate model between the SINR model and 
the protocol model. The idea is that, as the SNR of a link grows, the link can tolerate more 
interference. Hence, the interference distance is not fixed. 

Consider a pair (m, v) of nodes and an MCS m. The triple (m, v, m) is a link in the new 
model if SINR(m, v, 0) > 

Since both sides of a link transmit and receive, the interference set of a link must take 
into account interferences caused by other transmissions both in the receiver and the sender. 
However, the frames sent by the receiving side are in MCS 0, therefore, reception of these 
frames depends on the siNR-threshold /3o. 

The interference set K,?;,™ of the link e = {u, v, m) is defined by 

Vu,v,m = {xeV\{u} |sinr(m, V, {x}) < fi-f3^or 

smR{v,u, {x}) < 11- /3o} . 

The motivation for this definition is that transmissions of nodes in Vu,v,m interfere with the 
reception of v by u, or vice versa. The choice of /x = 1.585 gives us a margin of 2dB above the 
SiNR-threshold. This margin keeps the SINR above the threshold due to interferences caused 
by transmitters not in Su,v,m- 

We also define the interfering set of edges with respect to the link e = {u,v,m). 

Iu,v,m ={e' = (m', v', m') I {u', v'} n {V„ U V„) ^ 0} 

The interference set Iu,v,m contains a link e' if either endpoint of e' interferes with reception at 
the endpoints uox^v. 

Notation. Let u and v denote nodes and m denote an MCS. A link is a triple m) such that 
SINr(m, 0) > /3„j. This definition implies that there can be multiple parallel links between 
u and V, each with a different MCS. We denote the set of links by E. The set Egutiy) (resp. 
Einiy)) denotes the set of links that emanate from (resp. enter) v. Let E{y) denote the set of 
links Einiy) U Eout{v). For a link e = (u, v, m), let MCS(e) = m, i.e., the MCS m of the link e. 
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4 Algorithm MF-I-S 



4.1 Networks Governed by Time-Slotted Frequency Tables 

Two tables govern the communication in the network. The first table A is a time-slotted fre- 
quency table. The dimensions of A are F x T, where F denotes the number of frequency 
channels and T denotes the number of time slots. There is one row for each frequency channel 
and one column for each time slot. (In our implementation we used F = 3 and T = 200). 
The table A determines a periodic schedule. The second table is a multi-flow table mf. The 
dimensions of mf are \E\ x k (recall that k equals the number of video streams). The entry 
m/(e, s) specifies the number of packets-per-period that should be delivered along link e for 
stream s. 

Each table entry t] is a subset of links, i.e., t] C E. The table governs commu- 
nication in the sense that, in slot t', the links in A[j, t' (mod T)] try to deliver packets using 
frequency channel j. 

We use A[-,t\ to denote the set of links UjeFA[j,t]. Since we assume that each node is 
equipped with a single radio, it follows that two links that share an endpoint cannot be active 
in the same time slot. Hence, for every node v, E{v) H A[-,t\ may contain at most one link. 

A time-slotted frequency tables schedules active links as listed in Algorithm TX-RX in 
Appendix lAl Each node v executes Algorithm TX-RX(t') locally. Since E{y) fl A[-^t\ may 
contain at most one link, a node v is either a receiver, a sender, or inactive in each time slot. 

4.2 Algorithm Specification 

The input to the routing algorithm is specified in Sec. |2l The output consists of two parts: 
(i) a time-slotted frequency table A, and (ii) a multi-flow m/(e, s), for every link e and stream 
1 < s < k. We note that the units of flow are packets-per-period. The period equals T ■ a, 
where a is the duration of a time slot, and T equals the number of time-slots in a period. 

The multi-flow m/(e, s) determines the routing and the throughout of each stream. The role 
of the frequency /time- slot table A and the multi-flow tables is to specify a periodic schedule 
that determines which links are active in which time slots (see Sec. 14. II) . 

Although we use fixed length packets (e.g., 2KB), the MCS of a link determines the amount 
of time required for completing the delivery of a packet. This means, that within one time 
slot, multiple packets may be delivered along a single link. Let pps{e) denote the number of 
packets-per-slot that can be delivered along e. Namely, node u can transmit at most pps{e) 
packets to node v along link e = {u, v, m) in one time-slot. Note that the value of pps{e) is a 
function of the MCS of the link e. 

We say that table A supports the flow mf if the following properties hold: 

1. Every entry A[j, t] in the table is a set of non-interfering links. Thus, the links in A[j, t] 
may be active simultaneously. 

2. The data-rates m/(e, s) are supported by the table. Namely, 

k 

5^m/(e,s) < \{A[j,t] : e G A[j,t]}\ ■ pps{e) . (1) 

s=l 
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4.3 Algorithm Description 

Algorithm MF-I-S consists of two parts: (i) computation of a multi-commodity flow with 
conflict constraints, and (ii) scheduling of the multi-commodity flow in a time-slotted frequency 
table. We elaborate on each of these parts. 

Multi-commodity flow with conflict constraints. We formulate the problem of routing and 
scheduling the video streams by a linear program (LP). A similar LP is used in [ KMPS051 
IABL05 , BSTZOV] with respect to the graph model. We use our new interference model for the 
interference constraints. 

The variables // (e) of the LP signify the amount of flow along link e in frequency channel j 
for stream i. The full LP appears in Appendix|Bl Let /■'(e) = Yli=i fii^)^ namely, /•' (e) is the 
flow in frequency j along link e. Let c(e) = T ■ pps{e) denote the number of packets-per-period 
that can be delivered along the link e. 

We elaborate on two main features of the LP: 

1. The conflict constraints. The ratio f^{e)/c{e) equals the fraction of the time that the 
link e is active in transmission in frequency j. Since each node is equipped with a single 
WNIC, transmissions emanating or entering the same node may not occur simultaneously 
(in any frequency). In addition, the links in Jg may not transmit in frequency j whenever 
e is transmitting in frequency j. Thus, the conflict constraint is formulated as follows. 
For every link e = {u, v, m) G E, and for each frequency j G [L.3]: 



2. Max-Min throughput. For each requested stream rj, we define the supply ratio pi to be 
the ratio between the flow allocated to the i'th stream and the demand d* of the stream. 
The objective of the LP is to maximize min^ pj. A secondary objective is to maximize 
the total throughput. 

Scheduling of the multi-commodity flow in a time-slotted frequency table. In the schedul- 
ing step we are given the multi-commodity flows //(e). The task is to allocate entries in a 
time-slotted frequency table A that supports these flows. 

We first determine how many time-slots should be allocated for /•' (e), for each link e and 
each frequency channel j. Similarly to Eq. [U 




\{te[l..T]:eeA[j,t]}\-pps{e)>r{e) 



Hence, 



\{te[l..T]:eeA[3,t]}\> 



Pie) 



(2) 



pps{e) 
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The greedy scheduler. The simplest way to assign flows to the table A is by applying a 
greedy algorithm (similar to greedy coloring). The greedy algorithm scans the links and fre- 
quency channels, one by one, and assigns i{e,j) slots to each link e and frequency channel j. 
Based on [|ABL05[ IKMPS04L [BSTZOTH . the interference constraints in Eq.[l2] imply that the 
greedy algorithm succeeds in this assignment provided that 



Pie) 
pps{e) 



(3) 



The issue of dealing with this rounding problem (i.e., the difference between the round-down 
and the round-up in Eqs.|2]and|3]) is discussed in [Wan09 |, where it is pointed out that routing 
all the flow requires a super exponential period T. Such a period is obviously not practical; the 
computation of the table takes too long, the table is too long to be broadcast to all nodes, and 
the schedule will incur huge delays. 

We show that the rounding problem is not an important issue both theoretically and in 
practice. Since each flow /j can be decomposed into at most \E\ flow paths, it follows that the 
values of {f-{e)}eeE,jeF can be "rounded" so that at most \E\ ■ maxe{pps{e)} packets are lost 
per period. Note that this lost flow can be made negligible by increasing the period T. As T 
increases, the amount of flow per period tends to infinity, and hence, the lost flow is negligible. 
In our experiments 16.11 we used a period of T = 200 time slots, with a duration of 5ms per 
slot. The greedy scheduler was able to schedule almost all the flow in all the instances we 
considered. The multi-flow table is set so that m/(e, s) equals the amount of flow from /^(e) 
that the scheduler successfully assigned. 

The greedy scheduler incurred a delay roughly of one period per hop. The reason is that 
it schedules all the receptions to a node before the transmissions from the node. To avoid this 
delay, we designed a new scheduler, described below. 



The path-peeUng scheduler. The path peeling scheduler tries to reduce the time that an in- 
coming packet waits till it is forwarded to the next node. This is achieved as follows. 

1. Decomposes each flow /j into flow paths such that the flow along each path equals the 
bottleneck, i.e., the minimum pps{e) along the path. Let {fiip)}pev{i) denote this de- 
composition. 

2. While not all the flow is scheduled, 

(a) For i = Ito k do: 

(b) If V^i) 7^ 0, then schedule a path p E V{i) and remove p from V{i). 

The scheduling of a flow path p E V{i) tries to schedule the links in p one after the other 
(cyclically) to reduce the time a packet needs to wait in each node along p. The scheduling 
simply scans the links in p in the order along p, and finds the first feasible time slot (in cyclic 
order) for each link e E p. 

We point out that in Line[2al we schedule one path from each stream to maintain faimess 
in allocation and delays. On the average, each stream suffers from the same "fragmentation" 
problems in the table A. 

In our experiments, the path-peeling scheduler succeeded in scheduling 70% of the flow. 
The advantage, compare to the greedy scheduler, is that delays are significantly reduced. 
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5 Flow Control 



The multi-flow table computed by the algorithm determines the number of packets m/(e, s) that 
should be sent along each link e for stream s during each period. Each node v monitors the 
following information for each link e G Eout{v). 

1. P(e, s, t) - the number of packets belonging to stream s sent along the link e during the 
period t. 

2. P+ (e, s, t) - the maximum number of packets belonging to stream s that can be sent along 
the link e during the period t. Note that P^(e, s, t) > P(e, s, t); inequality may happen 
if the queue Q(e, s) is empty when a packet is scheduled to be transmitted along the link 
e. Note that if e is not planned to deliver packets of stream s, then P^(e, s, t) = 0. 

We remark that a node v can also monitor P{e,s, t) for a link e G Ei„(v). However, the value 
P+(e, s, t) for a link e G Ei„{v) must be sent to (e.g., by appending it to one of the delivered 
packets). 

The Flow-Control algorithm is executed locally by all the nodes in the network. Let e = 
(u, V, m) denote a link from u to v, and let s denote a stream. Each node executes a separate 
instance per stream. In the end of each period t, each node u "forwards" the value of P"*'(e, s, t) 
to node v. In addition, in the end of each period t, node v sends "backwards" the value P(e, s) 
to u. The value P(e, s) specifies the number of packets from stream s that v is willing to receive 
along the link e in the next period t + 1. 

Algorithm 1 Flow-Control(i;, s) - a local algorithm for managing the local queue and requested 
incoming rate at node v for stream s. 



1. Initialize: for all e G Ei„{v), R{e, s) m/(e, s). 

2. For t = 1 to oo do 

(a) Measure P(e, s, t) for every e G E{v), and P"'"(e, s, t) for every e G Eout{v). 

(b) Receive P+(e, s, t) for every e G Ein{v), and P(e, s) for every e G Eout{v). 

(c) Pi„ ^ min{^^g^^__^(^) P(e, s), 

(d) For every e G Ei„(v): R(e, s) Pi„ ■ — ^'^('^'■•^^'t) _ 

(e) Drop oldest packets from Q{v, s), if needed, so that \Q{v,s)\ < Rin- 



The Flow-Control algorithm is listed as Algorithm [T] It equalizes the incoming and outgo- 
ing packet-rates in intermediate nodes as follows. The requested packet-rate R{e, s) is initial- 
ized to be the value m/(e, s) derived from the table. The Flow-Control algorithm is activated in 
the end of each period. It uses the values P(e, s, t) and P"*"(e, s, t) for every link e incident to 
V. Some of these values are computed locally and some sent by the neighbors. The incoming 
packet-rate R^ is computed in line [2cl and is divided among the incoming links in line [2dl 
Excess packets in the queue Q{v, s) are dropped so that the number of packets in Q{v, s) is at 
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most Rin- The rational is that, in the next period, at most Rm packets will be delivered, and 
hence, excess packets might as well be dropped. 

We now elaborate on the boundary cases of the flow-control for a source and a destination 
bs of stream s. The destination bg simply sends a fixed request for each incoming link e G 
Ein{bs), i.e., -R(e, s) m/(e, s). The source a^, does not execute linel2dl instead, it sets the 
packet-rate of the video encoder to Rm- 

6 Experimental Results 

6.1 General Setting 

WiFi parameters. In the benchmarks that use the scheduler, each node has a single 802.1 Ig 
WNIC. In the benchmarks that do not use the scheduler, each node has three 802.1 Ig WNICs. 
The reason is that, in absence of the scheduler, a node does not know to which frequency 
channel to tune in each moment. 

Each WNICs transmits in one of three non-overlapping frequencies. All WNICs transmit 
at a fixed power (lOOmw). The path loss exponent is a = 4.1. The noise figure is = 
— 100(ii?m. The maximum communication is roughly 150m (in MCS 0). An interference 250m 
away can cause a decrease in the SINR of roughly IdB. We used fixed size packets with a 
payload of 2KB. Thus, a video stream with a 1Mbps generates 64 packets per second. 

Software tools. We used Coin-OR CLP to solve the linear programs. We implemented the 
scheduler in C-i-i-. The simulation was implemented using OMNET-i-i-/MixiM. Therefore, the 
simulation is done in the physical model taking into account path loss, multiple interferences, 
partial interference between frames, and all the details of the 802.1 Ig protocol. 

Algorithm parameters. We used T = 200 time slots in the time-slotted frequency table. 
Each time slot has a duration of 5ms. 

Implementation details. The following simplifications we made in the implementation. ( 1 ) Vir- 
tual flow control messages are used. They are sent without delay in the end of each period. We 
justify this simplification since flow control messages are very sparse. (2) Packets of only one 
stream are sent along each link in each time slot. This simplification only reduces the through- 
put of the implementation. 

6.2 Scenarios 

We ran the experiments on two main types of arrangements of the nodes in the plane: a circle 
and a grid. 

1. In the grid arrangement, we positioned 49 nodes in a 1km x 1km square. The nodes are 
positioned in a 7 x 7 lattice, so that the horizontal and vertical distance between adjacent 
nodes is 1000/7 = 142 meters (see Fig.|2]). The source and destination of the streams in 
the grid arrangement are chosen randomly. 
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2. In the circle arrangement, we positioned 24 nodes on a circle of radius 500 meters. The 
nodes were positioned every 360/24 degrees. The source and destination of the streams 
in the circle arrangement are chosen deterministically as follows: ai = [24//c], bi = 
(oj + [24:/ k\ ) mod 24, aj+i = b^, where k denotes the number of streams. 

We point out that random locations of 50 nodes in a square kilometer induces a communi- 
cation graph with a high degree and a diameter of 2 or 3 HMDS 1011 . In addition, the interference 
set of each link contains almost all the other links. Hence, this setting has a low capacity and is 
not an interesting setting for the problem we study. 

The requests demand d* is set to 10Mbps. Such a demand with k > 6 streams is above the 
capacity of the network. This enables us to study the performance in a congested setting. 

6.3 Benchmarks 

We ran the experiments using six algorithms. 

1 . MF-I-S . In the MF-l-S benchmark all three parts of our algorithm are used: computation 
of a multicommodity flow with interference constraints, the path-peeling scheduler, and 
the Flow-Control algorithm. 

2. ShortP-S . A shortest path maximum bottleneck routing algorithm with the path-peeling 
scheduler. Let pps{e) denote the number of packets-per-slot in the MCS used by the link 
e. Let hops{p) denote the number of hops along a path p. 

We define a (lexicographic) order over paths from as to bs as follows: p < g if (1) 
minegp/?/'5(e) > mSxie^qPps^e) or (2) Yiim.e(zppps{e) = m.me^qpps{e) and hops{p) < 
hops{q). Formally, in ShortP-S, the stream s is routed along a path p that is minimal in 
the lexicographic order. 

In ShortP-S, the paths are computed in an oblivious manner, namely, congestion does 
not play a role. This means that we must execute a flow control algorithm to adjust the 
data-rate. 

Each stream in the ShortP-S benchmark is assigned a random frequency channel. 

3. The remaining algorithms are MF (only multi-commodity flow without interference con- 
straints without a scheduler), MF-I (only multicommodity flow with interference con- 
straints without a scheduler), MF-S (multi-commodity flow without interference con- 
straints with a scheduler), ShortP (shortest paths but without a scheduler). A detailed 
description appears in Appendix IC.ll We point out that whenever the scheduler is not 
invoked, each node must have 3 WNICS. The reason is that a node does not know the 
frequencies of incoming packets. 

We made the following change in the WiFi WNlCs when there is a scheduler. The noise 
threshold for allowing a transmission of an RTS frame is reduced to match the interference 
distance. The reduced threshold relaxes the conservative collision avoidance to allow for si- 
multaneous transmissions by links approved by the scheduler. 
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k 


MF-I-S's 


ShortP-S's 


Ratio 




min Throughput 


min Throughput 






Mbps 


Mbps 




8 


0.576 


0.45 


1.28 


12 


0.448 


0.325 


1.3785 


16 


0.368 


0.22 


1.6727 



Table 1: Comparison of steady state min-throughput between MF-l-S and ShortP-S in the 
grid scenario. The number of requests is denoted by k. 
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Figure 1: Comparison of MF-l-S with the greedy scheduler and the path-peeling scheduler in 
the grid arrangement with k = 12 and d* = 10Mbps. The experiment's duration is 25 seconds. 



6.4 Results 

Comparison between MF-I-S and ShortP-S. We focus on two properties: min-throughput 
(i.e., the lowest throughput over all the streams) and the end-to-end delay. 

Table [U lists the effect of the number of requests k on the minimum throughputs of MF-l-S 
and ShortP-S in the grid scenario. MF-l-S outperforms ShortP-S by 28-67%. 

Comparison with Greedy Scheduler. In Figure [T] we compare MF-l-S with the greedy 
scheduler and the path-peeling scheduler. The path peeling scheduler significantly reduces 
the end-to-end delay while slightly reducing the throughput. Note that the min-throughput is 
bigger with the path peeling scheduler (i.e., stream #8), hence, fairness is improved. 

Benchmark Comparison. In Tables [2] and [3] we summarize the measured performance of the 
benchmarks for the grid and circle scenarios with A; = 12 requests and a demand d* = 10Mbps 
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for each stream. The experiment's duration is 25 seconds. Notice that the MF-I-S, MF-S, and 
ShortP-S benchmarks use only one WNIC per node, while the other benchmarks use three 
WNICs per node. 

We begin by discussing the grid scenario: 

(1) It is evident that the dropped packets rate is exceedingly high when the scheduler is not 
used. The reason is that the flow control algorithm fails to stabilize the queue length, as 
one would expect. 

(2) The minimum throughput obtained by MF-I-S is the highest. 

(3) The sum of the throughputs obtained by MF-I-S is 35% higher than that of ShortP, and 
140% higher than that of ShortP-S. 

(4) MF-I-S uses longer paths to avoid congestion and interference. 

(5) The scheduled benchmarks (i.e., MF-I-S ShortP-S and MF-S) have a very small drop 
rate. 

(6) All benchmarks have reasonable PER. 

The circle scenario is highly symmetric (i.e., 24 nodes and 12 streams) so we can suggest an 
optimal solution. This solution is a table with two slots. In slot 1, the "odd" links are scheduled. 
In slot 2, the "even" links are scheduled. We need only two frequencies: so that links separated 
by a link use different frequencies. In this solution, the flow along each link is half its capacity. 

Since the capacity of a link in this scenario is 8.2 Mbps , it follows that the flow along a 
link is 4.1 Mbps. Since streams are routed along disjoint paths, the throughput per stream is 
also 4.1 Mbps. 

In the circle scenario we obtained the following results: 

(1) The minimum throughput obtained by MF-I-S is 0.49 that of ShortP, and 0.5 that of 
ShortP-S. 

(2) The sum of the throughputs obtained by ShortP is only 75% more than that of MF-I-S. 

(3) Drop rate are small also for ShortP. 

In light of the fact that MF-I-S uses a single WNIC per node, it is clear that it outperforms 
all other algorithms. Most importantly, the end-to-end delay in MF-I-S is much shorter. 

Routing results. The routing result for A; = 12 streams is depicted for the grid scenario in 
Fig. [2] 
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Table 2: Comparison of the benchmarks for the grid scenario with k = 12 requests and d* = 
10Mbps for each stream. The experiment's duration is 25 seconds. 
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Table 3: Comparison of the benchmarks for the circle scenario with A; = 12 requests and 
d* = 10Mbps for each stream. The experiment's duration is 25 seconds. 
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(a) Grid scenario layout 

Figure 2: The grid scenario with 49 nodes, and A; = 12 requests. Flow paths, computed by 
MF-I-S, are depicted. An example of the splitting of flow can be seen for the request from 
node 49 to node 13. This request is split in to two paths along the perimeter of the rectangle 

(13,48,14,49). 

Note that a request may be split among multiple paths. 
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Table 4: Comparison of the drop percentage between ShortP and ShortP-S in the grid 
scenario. The drop percentage is the ratio between the number of dropped packets and the 
number of the transmitted packets. The simulations used k = 12 streams and a uniform demand 
ofd* = 10 Mbps. 
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Figure 3: (a) Comparison of total throughput between one and three radios, for SHORT? in the 
grid scenario with k = 12 and d* = 10Mbps. (b) Throughput comparison between ShortP-S 
and MF-I-S. Streams in each benchmark are sorted by their throughput for the grid arrange- 
ment with k = 16. The experiment's duration is 5 seconds. 



Comparison between ShortP and ShortP- S. Table |4] depicts the effect of applying 
the path-peeling scheduler on the greedy algorithm Short?, that is we compare algorithm 
ShortP and ShortP-S in the grid scenario. Recall that ShortP-S has a single radio in 
every node. The number of requests k is 12. The demand for every stream request is 10 Mbps. 

It can be seen that ShortP-S has no drops, hence our algorithm MF-I-S is compared to 
ShortP-S. 

Effect of number of streams. Table \T\ depicts the effect of the number of requests k on the 
minimum throughputs of MF-I-S and ShortP-S in the grid scenario. The number of requests 
A; is 8, 12, 16. The demand for every stream request is 10 Mbps. 

Clearly, the min-throughput decreases as the number of requests increases, as the same 
resources need to serve more requests. The advantage of MF-I-S is maintained for this range 
of requests. 

Effect of single radio on ShortP. Since ShortP uses 3 WNICs per node, we experi- 
mented also with a single WNIC per node. Figure |3a] depicts the effect of single radio on total 
throughput of ShortP. The ratio is almost constant and equals 3, as expected. 

The experiment was made in the grid arrangement, where The number of requests is A; = 12. 
The demand for every stream request is 10 Mbps. 
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Fairness. Figure l3b] compares the sorted throughputs achieved for the streams in MF-I-S 
and ShortP-S. The experiment was made in the grid arrangement, with k = 16 streams and 
d* = 10 Mbps. 

It can be seen that every request achieves less throughput in ShortP-S than in MF-I-S. 
Note that ShortP-S balances the throughput among its requests. 

The Flow-Control algorithm. Figure |4] depicts the effects of the Flow-Control algorithm in 
the grid arrangement with k = 12 and d* = 10Mbps. In Fig.[4al the requested rates R{e, s) 
are depicted. It can be seen that only slight perturbations occur over time. This justifies our 
simplified implementation that uses virtual flow-control messages. 

In Fig.|4bl the queue lengths of the stream in three different nodes are depicted. The oscil- 
lation is due to the periodic schedule. The queue length is controlled and stabilizes. 

In Fig. Hcl the drop ratio is depicted for the worst stream. The drop rate ranges from to 
1%. 

In Fig. |4dl the differences between the maximum and minimum throughput for MF-I-S 
and ShortP-S are depicted for all streams two seconds after the beginning of the experiment. 
It is evident that MF-I-S and ShortP-S are stable since the differences are smaller. 

7 Conclusions 

The algorithm consists of two parts: a multi-commodity flow computation and a scheduler. 
Our simulations demonstrate the robustness of the scheduler. Namely, the flows mf that are 
supported by the time-slotted frequency table A are successfully routed in the SiNR-model. 
Thus, in our simulations the modified graph model results with SiNR-feasible schedules. 

The role of the multi-commodity flow computation with interference constraints is to max- 
imize the minimum throughput. Indeed, in the grid scenario, routing along shortest paths re- 
sulted with smaller throughputs. 

The flow control algorithm succeeds in stabilizing the queue lengths for all benchmarks that 
used the scheduler. Without the scheduler, stability was not obtained, and many packets were 
dropped. 

Our results show that one can compute a routing and scheduling that succeeds in the SINR- 
model while using a simpler interference model. In addition, we successfully combined the 
various goals required to support video streaming. 

8 Discussion 

We propose a centralized algorithm for computing a routing, scheduling, and frequency assign- 
ment for real-time video streams in static ad-hoc wireless networks. The algorithm consists of 
two parts: a linear program and a scheduler. In addition, each node locally runs a flow-control 
algorithm to control the queues and stabilize data-rate along the links. Although the algorithm 
is centralized, it can be executed by multiple nodes in the network provided that they hold full 
information of the network (i.e., locations, requests). The output of the algorithm consists two 
tables that can be easily broadcast to all the nodes. 
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Figure 4: Influence of the Flow-Control algorithm in the grid arrangement with k = 12 and 
d* = 10Mbps. The experiment's duration is 25 seconds: (a) Change in the requested packet 
rate by the flow-control over time in MF-I-S, (b) Queue lengths of a stream in three different 
nodes in MF-I-S, (c) Ratio of dropped packets to transmitted packets over time in worst stream 
in MF-I-S, (d) Comparison of stability of throughput between MF-I-S and ShortP-S. 
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We implemented the algorithm and experimented using a setting that uses the physical 
model (with a 802. llg MAC) to verify the validity of the algorithm. Our experiments show 
that the traffic routed and scheduled by the algorithm is successfully delivered in two congested 
scenarios in the SiNR-model. 

We propose a scheduling algorithm, called the path peeling scheduler, that is designed to 
reduce the end-to-end delay incurred by the greedy scheduler. The path peeling scheduler 
succeeded in reducing the delay in streams with many hops. Even in a congested scenario, the 
path peeling scheduler successfully scheduled at least 70% of the flow. 
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A TX-RX Algorithm 



A listing of the TX-RX algorithm appears as Algorithm |2] We elaborate below how a queue 
Q{v, s) with the highest priority for transmission along link e in line|2]in the Transmit procedure 
is defined. 

Upon invocation of Transmit(e, j), where e = {v, u, m), the node v needs to decide which 
packet to transmit. The node v uses the multi-flow table mf to determine the set of streams 
that are routed along e. Since delay is a major issue, it is reasonable to use an EDD-like policy 
(Earliest Due Date), i.e., pick the oldest packet in the queues Q{v, s), for s E S^. However, 
such a policy ignores the remaining number of hops a packet needs to traverse. We prefer the 
approach that emphasizes fairness. That is, assign a priority that equals the ratio of the number 
of packets of stream s transmitted along e in the last period divided by the required number. 
The lower this ratio, the higher priority of the stream. This approach also combines well with 
the flow control algorithm described in Sec. |5] 



Algorithm 2 TX-RX(f ) - a local transmit-receive algorithm for node v as specified by a time- 
slotted frequency table A. 
For time slot t' = to oo do 

1. t = t' (mod T). 

2. if Ein{v) n t] 7^ then {reception mode} 

(a) Let e G Ein{v) fl t], where e{u, v, m) G A[j, t]. 

(b) While slot t is not over call Receive(e, j). 

3. if Eout{v) n A[-, t] 7^ then {transmission mode} 

(a) Let e G Eout{v) fl t], where e(f , u, m) G A[j, t]. 

(b) While slot t is not over call Transmit(e, j). 

Receive(e, j) - where link e = (m, f , m) and j is a frequency channel. 

1. Set tuner to reception in frequency channel j. 

2. Upon reception of a packet p from stream s, insert p to Q{v, s). 
Transmit(e, j)- where link e = {v, u, m) and j is a frequency channel. 

1. Set tuner to transmission in frequency channel j. 

2. Pick a queue Q{v, s) with a highest priority for transmission along e. 

3. p^ DEQUEUE{Q{v,s)). 

4. Transmit p along e. 



22 



k 

max 

i=l 

fi{e) > Vi G [l..k],\Jj e [1..3],Ve G E 



p + X ■ ^ (i* ■ Pi subject to (4) 



3 



k 
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c e ^-^ ^-^ c e' c e' 
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B The Linear Programming Formulation 

The main variables of the LP are the flow variables //(e) which signify the amount of flow 
along link e in frequency channel j for stream i. In Eq.[5]we require that the flows are nonneg- 
ative. In Eq.[6]we define /j(e) to be the combined flow along e for stream % over all frequency 
channels. In Eq.|7]we define /■'(e) to be the combined flow along e in frequency channel j over 
all k streams. Eq. [8]is simply a flow conservation constraint for stream % in every intermediate 
node. Eq.|9]is simply a capacity constraint for every link. In Eq[10l the supply ratio pi is defined 
to be the fraction of the demand for stream i that is supplied. In Eq. [TH p is defined to equal 
the minimum supply ratio, i.e., p = min^ pj. Finally, in Eq.[T2]the interference constraints are 
defined; we elaborate on them below. 

The objective is to maximize the minimum supply ratio p. As a secondary objective, we 
maximize the sum of flows. Therefore, the constant A in the objective function is small (e.g.. 
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A = 1/20). 

We point out that the capacity constraints in Eq. |9]are redundant since they are implied by 
the interference constraints in Eq. [121 

In our experiments, we noticed that the LP-solver found a solution with flow cycles. We 
removed these cycles before applying the scheduling step. Interestingly, the issue of flow cycles 
was not mentioned in previous works [|ABL05[ IBSTZ071 

C Experimental Results 

C.l Benchmarks 

We ran the experiments using six algorithms: 

1. ShortP- a shortest path maximum bottleneck routing algorithm. Let pps{e) denote the 
number of packets-per-slot in the MCS used by the link e. Let hops{p) denote the number 
of hops along a path p. In ShortP, the stream s is routed along a path p from a<j to hg 
such that, for every path p' from to hs, the following holds: 

nim.pps{e) > viim.pps{e) , and 
mSxipps^e) = m.mpps{e) 

e£p eep' 

=^hops{p) < hops{p'). 

The paths assigned to the k streams are divided evenly among the three frequency chan- 
nels. 

Each node in this benchmark contains three radios. This means that each node contains 
three standard 802.1 Ig WNICs, each working in different frequency channel. Since the 
frequency channels are non- overlapping, one WNIC may receive while another WNIC 
is transmitting. Each WNIC receives and transmits packets according to the WiFi MAC. 
Faimess between the streams is obtained as follows. Each WNIC is given FIFO-queue 
for each stream, the packets of which it needs to transmit. Each WNIC uses a simple 
round-robin policy for determining the queue from which the next packet is transmitted. 

The paths are computed in an oblivious manner, namely, congestion does not play a role. 
This means that we must execute a flow control algorithm to adjust the data-rate. To 
execute the Flow-Control algorithm without any changes, we trivially cast this routing to 
our setting as follows. We define the multi-flow m/(e, s) to equal d* if e is in the path 
assigned to stream s, and otherwise. The time-slotted frequency table A has a single 
time slot (i.e., T = 1) whose duration is one second. Namely, the table A has three 
entries, one for each frequency channel. The table entry for frequency channel j lists the 
links that use frequency channel j. 

2. MF-I-S . In the MF-I-S benchmark all three parts of our algorithm are used: computation 
of a multicommodity flow with interference constraints, the path-peeling scheduler, and 
the Flow-Control algorithm. 
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We emphasize that in this benchmark, each node contains a single radio; namely, each 
node has a single standard 802. 11 g WNIC capable of hopping between the three fre- 
quency channels in the beginning of each time slot. 

3. ShortP-S- same as ShortP except that every node contains a single radio. In addition, 
the path-peeling scheduler is applied, hence T — 200, and a random frequency channel 
is assigned to every request. 

4. MF-S - same as MF-I-S except that the LP does not include interference constraints. 
The scheduler resolves interferences, so it is interesting to see how much throughput is 
scheduled by the scheduler, and whether this throughput is routed in the simulation. 

We point out that the interference constraints constitute a large part of the LP constraints. 
By omitting them, the LP becomes shorter, easier to solves, and naturally, the LP solution 
has a higher throughput. 

Since the LP lacks interference constraints, the scheduler may fail to schedule the flow. 
We modified the scheduler in this case so that it augments the table A by adding time- 
slots. This augmentation has an adverse effect of reducing throughput and increasing 
delay. 

5. MF-I - same as MF-I-S but without the scheduler. Instead, the multi-flows are assigned 
in a single-slot schedule, as in Algorithm ShortP. We point out that in this benchmark, 
each node is equipped with three WNICs as in Algorithm ShortP. 

The motivation for this benchmark is that the multi-flow takes into account congestion 
and interference. Since the WiFi MAC deals with avoiding collisions, so it is interesting 
to see how it succeeds in scheduling the multi-flows in a distributed manner. 

As in ShortP, each node has three WNICS in this benchmark. 

6. MF - similar ShortP except that the streams are routed according to a multi-commodity 
flow. The multi-commodity flow is computed by an LP without interference constraints. 
This benchmark helps understand whether non-oblivious congestion aware routing im- 
proves performance. 

As in ShortP, each node has three WNICS in this benchmark. 
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